Coupled Transductive Ensemble Learning of Kernel Models

نویسندگان

  • Bart Hamers
  • Johan A.K. Suykens
  • Bart De Moor
  • Leslie Pack Kaelbling
  • B. De Moor
چکیده

In this paper we propose the concept of coupling for ensemble learning. In the existing literature, all submodels that are considered within an ensemble are trained independently from each other. Here we study the effect of coupling the individual training processes within an ensemble of regularization networks. The considered coupling set gives the opportunity to work with a transductive set for both regression and classification problems. We discuss links between this coupled learning and multitask learning and explain how it can be interpreted as a form of group regularization. The methods are illustrated with experiments on classification and regression data sets.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Ensemble Learning of Coupled Parameterized Kernel Models

In this paper we propose a new method for learning a combination of estimators. Classically, committee networks are constructed after training the networks independently from each other. Here we present a learning strategy where the training is done in a coupled way. We illustrate that combining parameterized kernel methods with output coupling and use of a synchronization set of data points le...

متن کامل

Ensemble Kernel Learning Model for Prediction of Time Series Based on the Support Vector Regression and Meta Heuristic Search

In this paper, a method for predicting time series is presented. Time series prediction is a process which predicted future system values based on information obtained from past and present data points. Time series prediction models are widely used in various fields of engineering, economics, etc. The main purpose of using different models for time series prediction is to make the forecast with...

متن کامل

Transductive Kernel Matrix Learningwith Hierarchic Bayesian Model, Application to Hyperspectral Images

In recent years, kernel methods have demonstrated their performance in hyperspectral imaging. Among the reasons their ability to handle large input spaces is essential. However for this type of applications a critical problem is the choice of the kernel which must combine spectral and spatial information [1] and of course achieve good generalization performance. The kernel design stage is gener...

متن کامل

Transductive Inference & Kernel Design for Object Class Segmentation

Transductive inference techniques are nowadays becoming standard in machine learning due to their relative success in solving many real-world applications. Among them, kernel-based methods are particularly interesting but their success remains highly dependent on the choice of kernels. The latter are usually handcrafted or designed in order to capture better similarity in training data. In this...

متن کامل

Transductive Reliability Estimation for Kernel Based Classifiers

Estimating the reliability of individual classifications is very important in several applications such as medical diagnosis. Recently, the transductive approach to reliability estimation has been proved to be very efficient when used with several machine learning classifiers, such as Naive Bayes and decision trees. However, the efficiency of the transductive approach for state-of-the art kerne...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003